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TITLE OF THE INVENTION 
ACCESS SYSTEM 
5 BACKGROUND OF THE INVENTION 

*:| Field of the invention 

'[ [0001] The present invention relates to an access system 

ifU in which a monitoring camera is connected to a network , such 

=50 as the Internet, and a server is accessed by using an image 

|* captured by the monitoring camera. 

Q Description of the Related Art 

O [0002] Currently, a variety of information described in 

HTML (Hyper Text Markup Language) can be interchanged on the 

15 World Wide Web (WWW). The Internet is greatly expandable 

and, in addition to the interchange of text data, a variety 
of information, e.g., still image information, moving image 
information, and Java programs, can be transferred. A user 
can obtain a lot of information via the Internet by linking 

20 resources in worldwide networks and can acquire information 
at a location designated by a unique URL (Uniform Resource 
Locator). In general, the URL specifies the address of an 
HTML file, for example, a homepage. Recently, for accessing 
organizations, URLs of homepages are described in various 

25 media such as magazines and signboards as well as on the 
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Internet. 

[0003] The Internet uses a system for distributing, in 
real time, video images such as a landscape by connecting a 
remote control camera. In this case, URLs are displayed on 
5 the signboards in the photographed video images. 
f==! [0004] Still images and moving images on the signboards 

% on which the URLs are printed can be easily captured as 

digital image data. Since no link information is included 
: in addition to the image information, after visually 

TO checking the URL, the user must access the homepage by 

r "' starting the browser and inputting the URL, which is 

%J troublesome. 

SUMMARY OF THE INVENTION 

15 

[0005] To solve the above-mentioned problem, it is an 
object of the present invention to provide an improved use 
experience. 

[0006] To accomplish this object, according to a first 
2 0 aspect of the present invention, there is provided an access 

system that includes: a display device for displaying an 
image photographed by an image pickup device on a screen; 
and a control device for extracting a character string 
included in the image displayed on the screen, interpreting 
25 the extracted character string, and starting software for 



- 3 - 



accessing an address included in the interpreted character 
string via a network. 

[0007] According to a second aspect of the present 
invention, there is provided an access system that includes: 
5 a receiving device for receiving an image photographed by an 

image pickup device; and a control device for extracting the 

:> predetermined symbol included in the image displayed on a 

screen by referring to a memory for storing a predetermined 
symbol and an address corresponding to the predetermined 

jo symbol and executing processing for accessing an address 

i j; corresponding to the extracted predetermined symbol. 

pj [0008] According to a third aspect of the present 

invention, there is provided an access system that includes: 

|! * a receiving device for receiving an image photographed by an 

15 image pickup device and information on the photographed 

image; and a control device for, when it is determined based 
on the information on the photographed image that the image 
received by the receiving device includes a predetermined 
image, referring to a memory for storing an address 

20 corresponding to the photographed image and executing 

processing for accessing an address corresponding to the 
predetermined image. 

[0009] According to a fourth aspect of the present 
invention, there is provided an access method that includes 
25 the steps of: extracting a character string included in an 
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image displayed on a screen; interpreting the extracted 
character string; and starting software for accessing an 
address included in the interpreted character string via a 
network . 

5 [0010] According to a fifth aspect of the present 

invention, there is provided an access method that includes 
the steps of: extracting a predetermined symbol included in 
an image displayed on a screen by referring to a memory for 
storing the predetermined symbol and an address 
1:0 corresponding to the predetermined symbol; and executing 
processing for accessing the address corresponding to the 
extracted predetermined symbol. 
"C [0011] According to a sixth aspect of the present 

'¥ H invention, there is provided an access method that includes 

15 the steps of: receiving an image photographed by an image 

pickup device and information on the photographed image; and 
when it is determined based on the information on the 
photographed mage that the image received by the receiving 
device includes a predetermined image, referring to a memory 
20 for storing an address corresponding to the photographed 
image and executing processing for accessing the address 
corresponding to the predetermined image. 
[0012] According to a seventh aspect of the present 
invention, there is provided a storage medium for storing a 
25 program for executing an operational processing method of an 
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access system, wherein the program includes: program code of 
an extraction step of a character string included in an 
image displayed on a screen; program code of an 
interpretation step of the extracted character string; and 
5 program code of an access step of starting software for 

accessing an address included in the interpreted character 
string via a network. 

[0013] According to an eighth aspect of the present 
invention, there is provided a storage medium for storing a 

10 program for executing an operational processing method of an 

access system, wherein the program includes: program code of 
an extraction step of a predetermined symbol included in an 

CI image displayed on a screen by referring to a memory for 

storing the predetermined symbol and an address 

15 corresponding to the predetermined symbol; and program code 

of an execution step of processing for accessing the address 
corresponding to the extracted predetermined symbol. 
[0014] According to a ninth aspect of the present 
invention, there is provided a storage medium for storing a 

20 program for executing an operational processing method of an 

access system, wherein the program includes: program code of 
a reception step of an image photographed by an image pickup 
device and information on the photographed image; and, when 
it is determined based on the information on the 

25 photographed image that the image received by the receiving 
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device includes a predetermined image, program code of an 
execution step of referring to a memory for storing an 
address corresponding to the photographed image and 
executing processing for accessing an address corresponding 
5 to the predetermined image. 

[0015] Further objects, features and advantages of the 
present invention will become apparent from the following 

ffi description of the preferred embodiments with reference to 

\i the attached drawings. 

10 

L BRIEF DESCRIPTION OF THE DRAWINGS 

;;; [0016] Fig. 1 is a diagram showing an example of a URL in 

the present invention. 
15 [0017] Fig. 2 is a diagram schematically showing an image 

distribution system. 

[0018] Fig. 3 is a diagram showing an example of an image 
transmitted by a server device. 

[0019] Fig. 4 is a diagram showing an example of a 
20 display on a client device. 

[0020] Fig. 5 is a diagram showing a configuration of 
software in the client device. 

[0021] Fig. 6 is a diagram showing the internal structure 
of an image recognition unit. 
25 [0022] Fig. 7 is a flowchart of processing of an image 
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recognition character string extraction unit. 

[0023] Fig. 8 is a flowchart of processing of a URL 

interpreting unit. 

[0024] Fig. 9 is a flowchart showing a process of another 
5 URL execution unit. 

[0025] Fig. 10 is a diagram showing an example of a URL 
'■U execution information table. 

v [0026] Fig. 11 is a diagram showing examples of symbols. 

Ill [0027] Fig. 12 is a flowchart of processing of a symbol 

10 extracting unit. 

[0028] Fig. 13 is a diagram showing an example of a 

symbol-URL table. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

15 

[0029] Hereinbelow, embodiments of the present invention 
will be described with reference to the drawings . 

First embodiment 
[0030] Fig. 1 is a diagram showing an example of a URL in 

20 the present invention. The URL is composed of a character 

string that indicates the location of a resource on the 
internet, for example a character string 100-001. URLs may 
be developed and changed in the future and will not always 
be described as shown in Fig. 1. According to the first 

25 embodiment , the URL specifies the character string 100-001 



- 8 - 

for uniquely identifying the resource on the network. The 
network may be the Internet, a WAN, or a LAN. The syntax of 
the character string 100-001 designating the URL may be 
extended in the future. 
5 [0031] The character string 100-001 is applied in a wide 

variety of fields and, for example, is used for specifying 
€1 the location of the homepage of a company. Referring to Fig. 

CB 1, the character string 100-001 denotes the address of the 

111 homepage of a corporation xyz. The user can obtain 

JjlO information such as customer information and product 

u, information using a character string including the URL. 

hi [0032] Fig. 2 is a diagram schematically showing an image 

~" distribution system for distributing, in real time, images 

photographed by a camera to a client via the network. A 
15 camera 200-001 connected to a server device 200-002 can be 

installed outdoors, and can photograph signboards, etc., in 
towns and can then transmit, in real time, the images to a 
client device 2 00-004 which can browse the images. The 
server device 2 00-002 can transmit the images photographed 
20 by a camera 200-001 connected thereto to the client via a 

network 200-003. Further, the server device 200-002 can 
transmit live moving image information and live still images 
and can process image information such as moving image 
information and still image information, which are stored in 
2 5 a storage device integrated or connected to the server 
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device 200-002. 

[0033] The client device 200-004 receives an image and 
information which are transmitted by the server device 200- 
002 and, thus, the user can browse the image and the 
5 information. A display 200-005 connected to the client 
device 200-004 displays the image and the information. 
* [0034] The server device 200-002, which transmits the 

; image, is connected via the network 200-003 to the client 

■I device 200-004, which browses the transmitted image. 

=11 0 Although in the first embodiment the network 200-003 is the 
I* internet, it may be various networks such as a WAN or a LAN. 

Q [0035] Fig. 3 is a diagram showing an example of the 

image transmitted by the server device 200-002. URLs 300- 
001 and 300-002 are shown as examples, which are written on 
15 signboards on a landscape image such as a building. 

[0036] Fig. 4 is a diagram of an example of the display 
on the client device 200-004. A window 400-001 is opened by 
a browser application and existing HTML text data is 
displayed thereon. A user browses the image and the 
20 information on the display shown in Fig. 4. 

[0037] Fig. 5 is a diagram showing a configuration of 
software in the client device 200-004. Reference numeral 
500-001 denotes an Internet browser, 500-002 denotes an 
execution information table used for executing the URL shown 
25 in Fig. 10, which will be used in a second embodiment of the 
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present invention, as shown in Fig. 13 , and 500-003 denotes 
an image recognition unit. 

[0038] Existing software can be used for the Internet 
browser. More specifically, widely used browser software, 
5 e.g., Internet Explorer and Netscape Navigator, or 

alternatively, software having functions similar thereto may 
be used. The software has a URL execution information table 
as shown in Fig. 10, such as a MIME-type table, and 
processes various data types. 
"10 [0039] The image recognition unit 500-003 is software for 

recognizing and extracting URL character string information 
in an image obtained by the Internet browser 500-001 
according to the first embodiment. 

[0040] Fig. 6 is a diagram showing the internal structure 

15 of the image recognition unit 500-003. 

[0041] The image recognition unit 500-003 comprises an 
image receiving unit 600-003, an image recognition character 
string extraction unit 600-004, a URL interpreting unit 600- 
005, and a URL execution unit 600-006. The image receiving 

20 unit 600-003 receives the image transmitted by the server 

device 200-002. The image recognition character string 
extraction unit 600-004 determines whether or not there is a 
character string in the digital moving image or still image 
captured by the image receiving unit 600-003 and extracts a 

25 URL character string if one exists in the character string. 
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The URL interpreting unit 600-005 determines whether or not 
the syntax of the extracted URL is in the correct notation 
and whether or not it is correctly interpreted. The URL 
execution unit 600-006 jumps to the link destination of the 
5 URL interpreted by the URL interpreting unit 600-005 in 
accordance with a predetermined operation. 
[0042] The image recognition unit 500-003 can be 
w implemented by a plug-in method of the Internet browser 500- 

fy 001 (method for adding an application function) and can also 

10 be implemented by a Java applet. The image recognition unit 

500-003 may be implemented by using any desired method for 
receiving the image from the Internet browser 500-001. The 
image receiving unit 600-003 receives the image in 
accordance with the method used. Incidentally, according to 
15 the first embodiment, the image receiving unit 600-003 

receives the image information, which is periodically (in 
real time) transmitted from the Internet browser 500-001. 
[0043] The image recognition character string extraction 
unit 600-004 identifies and captures the character string 
20 based on the received digital moving image or still image, 

and extracts information including the character string from 
the received image. The URL interpreting unit 600-005 
determines whether or not the syntax of the extracted URL is 
in the correct notation and whether or not it is correctly 
25 interpreted. The URL execution unit 600-006 executes 
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processing in accordance with the data indicated by the 
extracted URL. 

[0044] Fig. 7 is a flowchart of a process of the image 
recognition character string extraction unit 600-004. 
5 [0045] In processing for recognizing a tone pattern of 

the image in step S101, full-color image data transmitted by 
: the server device 200-002 is converted into binary image 

f ;:i data. As a consequence, the URL character string displayed 

;y on the signboard can be relatively easily understood. The 

|p character string is recognized by recognizing the tone 
L» pattern of the binary digital image. The character string 

^ can be extracted from the captured digital image by a method 

Jij similar to a well-known optical recognizing method using an 

r " OCR ( Optical Character Reader ) . 

15 [0046] In processing for recognizing the character string 

in a frame in step S102, the frame of the signboard or the 
like is used for recognition and the character string in the 
frame is recognized, since the signboard photographed in the 
landscape image is normally surrounded by a frame, such as a 

20 box, in many cases. Then, characters in the character 

string in the frame are arranged by rotating the characters 
to arrange them at different angles, and so on, so as to 
correctly recognize them. The arrangement may be performed 
by other methods apart from the rotation. 

25 [0047] In processing for recognizing the character string 
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in step S103, a normalized URL character string is 
recognized. 

[0048] Fig. 8 is a flowchart showing a process of the URL 
interpreting unit 600-005. 
5 [0049] Generally, a URL syntax notation is formed by 

using compilers for context analysis, syntax analysis, etc. 
^| in step S201, it is determined whether or not the URL is 

~\ correctly interpreted. If the result is NO in step S2 01, 

!r; the processing enters a standby mode until the Internet 

10 browser 500-001 obtains an image again. If the result is 
? YES in step S201, the link destination of the address 

If; interpreted is automatically accessed by a predetermined 

operation. 

I* [0050] Fig. 9 is a flowchart showing a process of the URL 

15 executing unit 600-006. 

[0051] Referring to Fig. 9, first, the URL executing unit 
600-006 obtains the data type indicated by the URL in step 
S301. Thus, the data type indicated by the URL is 
determined . 

20 [0052] In step S302, execution processing is determined 

based on the determined data type of the URL and the 
execution information table shown in Fig. 10, corresponding 
to the recognized URL. Incidentally, referring to Fig. 10, 
the phrase "MIME-Type" denotes the data type indicated by 

25 the URL, and is an existing data type, etc., prescribed in 



- 14 - 



RFC (Request For Comment) documents. The term "Command" 
indicates which application is used to open and view the URL, 
The URL execution information table in Fig. 10 may be shared 
with the Internet browser 500-001 or may be uniquely set by 
5 the image recognition unit 500-003. Alternatively, the user 

may freely set the URL execution information table in Fig. 
10. 

[0053] In step S303, it is determined whether or not the 
extracted URL character string is displayed in the image on 

10 the window 400-001. If the user changes the photographing 

direction of the camera 200-001 or the zoom magnification 

* and no extracted URL character string is displayed in the 

image on the window 400-001, it is determined that the user 
is no longer concerned about the URL character string and 

15 the execution processing of the URL is not performed. If 

the extracted URL character string is displayed in the image 
on the window 400-001, the processing routine advances to 
step S304. The determination in step S303 may be performed 
by recognizing the URL character string again, or by 

20 receiving the image and information on the image 

photographed by the camera 200-001 from the server device 
2 00-002 and then determining whether or not the current 
photographed image includes the photographed image when the 
URL character string is recognized. 

25 [0054] In step S304, by clicking on the image including 
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the recognized URL in the window 400-001, the browser 
software 500-001 is automatically started, thus execution 
processing corresponding to the URL data type. If the image 
captured by the camera 200-001 includes no recognized URL, 
5 the processing corresponding to the recognized URL is not 
executed . 

J! [0055] As mentioned above, according to the first 

embodiment, the URL can be obtained from the digital moving 
image data or the still image data photographed in real time 

10 and the URL can be processed. 

I\ ; [0056] Second embodiment 

; Although the URL character string in the image is 

recognized and the processing of the recognized URL is 
p : executed according to the first embodiment, a symbol of a 

15 company such as a logo can be recognized, as shown in Fig. 

11, from the image. The URL of the recognized company is 
obtained from a previously stored table, and the processing 
of the obtained URL is executed according to the second 
embodiment . 

20 [0057] Incidentally, according to the second embodiment, 

the structure and the operations are similar to those of the 
first embodiment, apart from the fact that the processing of 
the image recognition character string extraction unit 600- 
005 is replaced with the processing of a symbol extraction 

25 unit 600-007, and the URL interpreting unit 600-005 is 
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unnecessary. 

[0058] Fig. 12 is a flowchart showing operational 
processing of the symbol extraction unit 600-007 according 
to the second embodiment. 

[0059] First, in step S401, it is determined whether or 
not there is a symbol that is stored in a symbol-URL table, 
as shown in Fig. 13, in the captured image. The symbol-URL 
table in Fig. 13 stores information on shapes and colors of 
symbols A, B, C, which is used for determining the symbol. 
If the result is YES in step S401, the processing routine 
advances to step S402, whereupon the URL corresponding to 
the recognized symbol is determined from the symbol URL 
table in Fig. 13 and the processing corresponding to the 
determined URL is executed by the URL execution unit 600-006. 
If the result is NO in step S401, the process enters a 
standby mode until an image is received from the Internet 
browser 500-001 again. 

[0060] Additionally, the URL executing unit 600-006 
determines whether or not the extracted symbol is displayed 
on the window 400-001. If the user operates the camera 200- 
001 and an image including the recognized symbol is not 
displayed on the window 400-001, it is determined that the 
user is no longer concerned about the symbol and the 
execution processing of the URL is not performed. It may be 
determined whether or not the extracted symbol is displayed 
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in the image on the window 400-001 by recognizing the symbol 
again, or by receiving the image and information on the 
image photographed by the camera 200-001 from the server 
device 200-002 and then determining whether or not the 
5 current photographed image includes the photographed image 

when the symbol was recognized. 

[0061] If the image including the recognized symbol is 
■\b displayed on the window 400-001, similarly to the case of 

"11 the first embodiment, by clicking the image including the 

10 recognized symbol in the window 400-001, the URL executing 

;y : unit 600-006 executes processing corresponding to the URL 

" determined in step S402. If the image captured by the 

2f camera 200-001 including no symbol recognized is clicked, 

the processing corresponding to the determined URL is not 
15 executed. 

[0062] As mentioned above, according to the second 
embodiment, the table pre-stores information on the URL 
corresponding to the symbol and information for recognizing 
the symbol such as the company logo. The symbol is 
20 extracted from the image, which is photographed in real time, 
and the processing of the URL corresponding to the symbol 
extracted from the symbol-URL table is executed. 
Accordingly, it is possible to provide a system that is 
convenient for the user. 
25 [0063] According to the first and second embodiments, the 



- 18 - 



server accesses the detected URL. However, an email address 
may be detected, email software may be started, and the 
detected address may be accessed by transmitting the email. 
[0064] A storage medium for storing program code of 
5 software for executing the above-mentioned functions is 

provided in a system or an apparatus, and a computer (such 
% as a CPU or an MPU) in the system or the apparatus reads and 

; executes the program code stored in the storage medium. 

Thus, the functions in the first and second embodiments can 
jo be effected. 

[0065] In this case, the program code read from the 
If; storage medium realizes the functions in the first and 

second embodiments, and the present invention comprises the 
¥ h storage medium which stores the program code. 

15 [0066] As for the storage medium for supplying the 

program code, it is possible to use a floppy disk, a hard 
disk, an optical disk, a magneto-optical disk, a CD-ROM, a 
CD-R, a magnetic tape, a nonvolatile memory card, a ROM, and 
the like. 

20 [0067] The functions in the first and second embodiments 

can be effected not only by executing the program code read 
by the computer, but also by executing a part or all of the 
actual processing by an OS (Operating System), which 
operates on the computer, on the basis of the instructions 

25 of the program code. 
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[0068] Further, the functions in the first and second 
embodiments can be effected by writing the program code read 
from the storage medium into a memory provided for an 
expansion board inserted in the computer or an expansion 
unit connected to the computer, and thereafter executing a 
part or all of the actual processing by a CPU, etc., 
provided for the expansion board or function expansion unit, 
on the basis of the instructions of the program code. 
[0069] When the storage medium is applied to the first 
and second embodiments, the storage medium stores the 
program code corresponding to the above steps. in other 
words, the storage medium stores modules necessary for the 
URL obtaining system according to the first and second 
embodiments . 

[0070] According to the first and second embodiments, the 
URL or the predetermined symbol is extracted from the image 
obtained via the Internet by image recognition and the 
processing of the URL is automatically performed. 
Consequently, the convenience for the user can be improved. 
[0071] While the present invention has been described 
with reference to what are presently considered to be the 
preferred embodiments, it is to be understood that the 
invention is not limited to the disclosed embodiments. On 
the contrary, the invention is intended to cover various 
modifications and equivalent arrangements included within 
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the spirit and scope of the appended claims. The scope of 
the following claims is to be accorded the broadest 
interpretation so as to encompass all such modifications and 
equivalent structures and functions. 



